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Abstract 

We explore the capacity and generalized degrees of freedom of the two-user Gaussian X channel, i.e. a 
generalization of the 2 user interference channel where there is an independent message from each transmitter to each 
receiver There are three main results in this paper First, we characterize the sum capacity of the deterministic X 
channel model under a symmetric setting. Second, we characterize the generalized degrees of freedom of the Gaussian 
X channel under a similar symmetric model. Third, we extend the noisy interference capacity characterization 
previously obtained for the interference channel to the X channel. Specifically, we show that the X channel associated 
with noisy (very weak) interference channel has the same sum capacity as the noisy interference channel. 
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I. Introduction 

Recent research in multi-user information theory has been characterized by a surge of interest in the study of 
capacity regions of wireless Gaussian networks. Much of this interest has been fueled by significant recent progress 
in the search of the capacity region of wireless interference networks, a classical problem of multi-user information 
theory. In their seminal work [1], Etkin, Tse and Wang approximated the capacity region of the two-user Gaussian 
interference channel to within one bit. Further insight into the capacity of the two-user Gaussian interference network 
was revealed in [2]-[4]. These references found that the decoding strategy of treating interference as noise at each 
receiver in the interference network is capacity optimal for a class of interference channels, known as the "noisy 
interference" channels. Recent results have also found approximations to the capacity regions of certain classes of 
the K-user interference channel in the high signal-to-noise ratio (SNR) regime. Reference [5] approximated the 
capacity region of the fully connected if -user interference channel with time-varying channel coefficients as 

C(SNR) = y log (SNR) + o(log(SNR)) 

where SNR represents the total transmit power of all nodes when the local noise power at each receiver is normalized 
to unity. In other words, it was shown that the time-varying K-user interference channel has ^ degrees of freedom. 
Similar capacity approximations of the K-user (K > 2) interference channel with constant channel coefficients 
(i.e., not time-varying or frequency-selective) are not known in general. 

From the recent advances in the study of interference channels, many interesting and powerful tools related to 
the study of general wireless networks have emerged. Reference [1] introduced the notion of generalized degrees of 
freedom to study the performance of various interference management schemes in the interference channel. As its 
name suggests, the idea of generalized degrees of freedom is a generalization of the concept of degrees of freedom 
originally introduced in [6]. The idea of generalized degrees of freedom is powerful because in the multiple access, 
broadcast and two-user interference channels, achievable schemes that are optimal from a generalized degrees 
of freedom perspective also achieve within a constant number of bits of capacity [7]. A useful technique in the 
characterization of the generalized degrees of freedom of a wireless network is the deterministic approach, originally 
introduced in the context of relay networks [8]. The deterministic approach essentially maps a Gaussian network 
to a deterministic channel, i.e, a channel whose outputs are deterministic functions of its inputs. The deterministic 
channel captures the essential structure of the Gaussian channel, but is significantly simpler to analyze. Reference 
[7] showed that the deterministic approach leads to a characterization of the generaUzed degrees of freedom of 
wireless networks in the two-user interference network, which leads to a constant bit approximation of its capacity. 

In this paper, we explore the two-user X channel - a network with two transmitters, two receivers and four 
independent messages - one corresponding to each transmitter-receiver pair. The degrees of freedom of the Gaussian 
X channel have been found in [9], [10]. This work pursues a more refined characterization in terms of the generalized 
degrees of freedom. Unhke the conventional degrees of freedom perspective where all signals are approximately 
equally strong in the dB scale, the generalized degrees of freedom perspective provides a richer characterization by 
allowing the full range of relative signal strengths in the dB scale. For example, consider the interference channel. 
The strong and weak interference scenarios are not visible in the conventional degrees of freedom perspective 
but become immediately obvious in the generalized degrees of freedom framework. Now consider the X channel 
which is a generaUzation of the interference channel to a scenario where every transmitter has a message to every 
receiver. One of the key features of the X channel is that, unhke the two-user interference channel, it provides 



3 



W^ll,W21 



Wl2, W22 




Fig. 1. The two-user Gaussian X channel 

the possibility of interference alignment [9], [10]. Interference alignment refers to the construction of signals such 
that they overlap at receivers where they cause interference, but remain distinguishable at receivers where they are 
desired. Interference aUgnment is the key to the degrees of freedom characterizations of the X channel with 2 or 
more users [11], and for the interference channel with 3 or more users [5]. Since the potential for interference 
alignment does not arise in the 2 user interference channel, the two-user X channel provides the simplest possible 
setting for interference alignment, in terms of the number of transmitters/receivers and channel coefficients. It is 
shown in [10] that, due to interference alignment, the 2 user X channel has 4/3 degrees of freedom (assuming time- 
varying channels), while the 2 user interference channel has only 1 degree of freedom. In this work, we explore this 
capacity advantage of the X channel over the interference channel in the richer context of the generalized degrees 
of freedom. Specifically we quantify the benefits of interference alignment in terms of generalized degrees of 
freedom and identify operating regimes where alignment helps the X channel outperform the interference channel. 
For simplicity, we will keep the number of channel parameters to a minimum by using the symmetric interference 
channel as our benchmark and presenting our main results for the corresponding symmetric X channel. 

Our approach to solving the generalized degrees of freedom of the X channel follows the deterministic approach 
of [12]. We first introduce the deterministic X channel, and find a tight outerbound and achievable scheme for the 
sum capacity of this channel in Section JV] In Section |Vl we extend the achievability and outerbound arguments 
of Section |IV] to the Gaussian X channel yielding its generalized degrees of freedom. A second result we obtain 
is a generalization of the results of [2]-[4] to find the capacity of the Gaussian X channel for a class of channel 
coefficients. We introduce the system model, formally define the notion of generalized degrees of freedom, and 
present the main results in the next section. 

II. System Model 

A. Deterministic X Channel 

The deterministic X channel is physically the same channel as the deterministic interference channel introduced 
in [7], except that the X channel has 4 independent messages {W^n, W12, W21, W22} where Wij is the message that 
originates at transmitter j and is intended for receiver i. Note that the interference channel has only 2 independent 
messages, e.g., {Wii,VF22} or {^12,^^21}. The deterministic channel is shown is Fig. |2] and described by the 
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Fig. 2. On the left is an example of the deterministic interference channel. On the right is the figure that shows only the signal levels 
observed at each receiver. 



input output equations 



Yi{t) = S''-'^"Xi(t) + S«-"-X2(0 
Y2(t) = S«-"=iXi(t) + S«-"^=X2(i) 

where q = max(nii, n2i, ni2, n22), Xj(t), Yj(t) e for i = 1,2, and S is a q x q shift matrix, 
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The message set and standard definitions and notations of the achievable rates are similar to those in the Gaussian 
setting. To avoid confiision, sometimes we add the subscript det to distinguish the notations for the deterministic 
channel from those for the Gaussian channel. 



B. The Gaussian X Channel 

The two-user Gaussian X channel is described by the input-output equations 

Yi{t) = HiiXi{t) + Hi2X2{t) + Zi{t) 

Y2{t) = H2lXi{t) + H22X2{t) + Z2{t) 



(4) 
(5) 
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where at symbol index t, Yj{t) and Zj{t) are the channel output symbol and additive white Gaussian noise (AWGN) 
respectively at receiver j. Xi{t) is the channel input symbol at transmitter i, and Hji is the channel gain coefficient 
between transmitter i and receiver j for all i,j G {1,2}. All symbols are real and the channel coefficients do not 
vary w.r.t symbol index. In the remainder of this paper, we suppress time index t if no confusion would be caused. 
The AWGN is normalized to have zero mean and unit variance and the input power constraint is given by 

E[Xf] <P„ i = l,2. (6) 

There are four independent messages in the X channel: Wu, W12, W21, W22 where Wij represents the message 
from transmitter j to receiver i. We indicate the size of the message by \Wij\. For codewords spanning T symbols, 
rates Rij = j^'j are achievable if the probability of error for all messages can be simultaneously made arbitrarily 
small by choosing an appropriate large T. The capacity region C of the X channel is the set of all achievable rate 
tuples R = i2i2, ii2i> -^22)- We indicate the sum capacity of the X channel by Cs. 

1) Generalized Degrees of Freedom (GDOF): To motivate our problem formulation, we briefly revisit the 
framework for the generalized degrees of freedom characterization of the symmetric interference channel. The 
interference channel is defined as: 

Yi{t) = V^Mxi{t) + VmKX2{t) + Zi{t) (7) 

Y2{t) = ViNRXi(t) + VSNRX2(t) + Z2(i) (8) 
and with the parameter a defined as follows 



the GDOF metric is defined as [1], 



log(SNR) ^ ' 

Cs(SNR,a) 

a(a) = lim sup (10) 

SNR^<i ilog(SNR) 

where Cs(SNR, a) is the sum capacity of the interference channel. 

Since our main goal is to compare GDOF of the X channel with the interference channel, we use the same 
symmetric interference channel model described above as the physical channel model for the X channel. There 
is however, one notational difference. Since the terminology SNR,INR is not as appropriate for the X channel, 
we instead use the parameter p to substitute for these notions, resulting in the following system model for the X 
channel GDOF characterization: 

Yi{t) = ^Xi{t) + ./^X2{t) + Zi{t) (11) 
Y2{t) = ^Xi{t) + ^pX2{t) + Z2{t) (12) 

In other words, we have set Hu = H22 = a/P' H12 = H21 = y/p^, and = P2 = 1. Note that ^T^, (fT2l ) 
represent the same physical channel as Q, dSjl. However, as mentioned earlier, unlike the interference channel the 
X channel has 4 independent messages - one from each transmitter to each receiver. The GDOF characterization 
for the X channel is defined as: 

\ r Cs{p,a) 
a(a) = lim sup (13) 
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where Cs (p, a) is the sum capacity of the X channel. 

Note that we use limsup to ensure that d{a) always exits. The half in the denominator is because all signals 
and channel gains are real. 



III. Main Results 

A. Sum Capacity of the Symmetric Deterministic X Channel 

The first main result of the paper is the characterization of the sum capacity of the symmetric deterministic X 
channel in the symmetric setting where nn = 71-22 = and ni2 = ^21 = ric. This result is given in the following 
theorem. 

Theorem 3.1: The sum capacity Cj:{nc,nd) of the symmetric deterministic X channel, i.e., the deterministic X 
channel where nn = 7122 = and ni2 = ^21 = na, is 
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(14) 



B. Generalized Degrees of Freedom of the Symmetric Gaussian X Channel 

The second main result of this paper builds upon the result of Theorem 13.11 to find the generalized degrees of 
freedom characterization (shown in Figure O for the Gaussian X channel. 

Theorem 3.2: The generalized degrees of freedom d{a) of the symmetric Gaussian X channel can be charac- 
terized as 
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(15) 



For comparison. Figure |3] also shows the generalized degrees of freedom characterization of the symmetric 
interference channel as obtained in [1]. For values of a < 2/3, characterization of d{a) is identical for both the 
symmetric two-user Gaussian X channel and the symmetric two-user Gaussian interference channel (See [1] Figure 
14.5b . We prove this by showing that the Etkin-Tse-Wang (ETW) outerbound derived for the interference channel 
[1] holds for the X channel as well (See Theorem 15.31 ). The ETW outerbound is tight from a GDOF perspective 
in the interference channel for a < 2/3. Therefore, our extension of this outerbound implies that for a < 2/3 a 
GDOF optimal achievable scheme is to set W12 = W12 = 4>, so that the X channel operates as an interference 
channel. For example, if a < 1/2, setting W21 = W12 = 4> and treating interference as noise is GDOF optimal in 
the X channel, since it is optimal in the corresponding interference channel [1]. Similarly, we show that for a > |, 
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Fig. 3. Generalized Degrees of Freedom of the symmetric X channel, and a comparison the the 2 user interference channel 

it is GDOF optimal to set W22 = Wu = cj) and operate the X channel as an interference channel with messages 
W12 and W21. It must be noted that for both q < 2/3 and a > 3/2 the GDOF optimal achievable scheme operates 
the X channel as weak interference channel by setting the appropriate messages to null. For 2/3<a<3/2, we 
propose an interference alignment based achievable scheme for the X channel. Thus, in this regime, the X channel 
performs better than the interference channel by exploiting the possibility of interference alignment. 

C. Capacity of the "Noisy " Gaussian X Channel 

References [2]-[4] showed that in the interference channel, for a class of channel coefficients, encoding messages 
using Gaussian codebooks and decoding desired messages by treating interference as noise at each receiver is 
capacity optimal. Our last main result extends this conclusion to the X channel as well. We show that if a 2 
user interference channel satisfies the noisy interference conditions obtained in [2]-[4] then the corresponding X 
channel obtained by allowing all transmitters to communicate with all receivers, has the same sum capacity as 
the original noisy interference channel. This is a surprising result since it implies that for a class of X channels, 
interference alignment has no capacity benefit. The result holds for the general (asymmetric) X channel and is 
stated as such in Theorem 16.11 in Section |Vll For simplicity we re-state the result here for the symmetric case 
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(Hii = H22 = 1, H12 = H21 = h, Pi = P2 = P) in a notation consistent with [4], as follows. 

Noisy "Symmetric" X Channel Result: If \h{ \ + h?P^ 1 — 5' ^^^^ capacity of the Gaussian X channel 

is given by Cs = log ^1 + xqi^p^- Similarly, if \h\ > 2(1 + P) then the sum capacity of the Gaussian X channel 
is given by Cs = log (^1 + 

The condition \h [l + h'^P) \ < ^ is the same as the noisy interference condition in [4]. It means that when the 
cross-links are too weak, there is no sum-capacity benefit in communicating messages over those links {X channel 
operation), even though it rules out interference alignment, and we are better off just communicating on the direct 
links while treating the weak interference as noise. Thus, in this case messages Wi2,W2i do not increase sum 
capacity of the X channel. 

The other condition \h\ > 2(1 + P) refers to a strong cross-channel scenario. It says that when the cross-links are 
too strong relative to direct links, then sum capacity is achieved by communicating only over the strong cross-links 
and treating the weak interference received over the direct links as noise. In this case, messages Wu, W22 do not 
increase the sum capacity of the X channel. 
Notation: In the rest of this paper, we use the notation 

^(^) = (^(i),^(2),...^(r)) 

for any sequence A. 

IV. Sum Capacity of the Symmetric Deterministic X Channel 
The deterministic X channel model is described in the symmetric setting by: 

Yi(t) = S''~"''Xi(t) + S«-'^=X2(t) (16) 
Y2(t) = S''^"=Xi(t) + S«-'^^X2(t) (17) 

where q = max(rec,nd). 

To prove Theorem 13. 1[ we use the following lemma. 
Lemma 4.1: 

Cj]inc,nd) = CY.{nd,nc) (18) 
The lemma follows trivially from the symmetry in the X channel. We now proceed to derive the converse argument 
for Theorem 13.11 

A. Upperbounds 

In this section, we start from the capacity outerbounds for the (asymmetric) deterministic X channel, and then 
we use the results to derive the capacity outerbounds for the symmetric setting. The following lemma provides a 
set of outerbounds for the achievable rate tuple {Ru, R21, R12, R22) of the (asymmetric) deterministic X channel. 

Theorem 4.2: The achievable rate tuple (i^n, i?2i, ^12, R22) of the deterministic X channel satisfies the follow- 
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ing inequalities. 

Rii + i?i2 + R22 < max (nil, ni2) + {n22 - 
Rii + R21 + R22 < max (n2i, ^22) + (nn - 
-Rii + R21 + R12 < max (nil, ni2) + {n2i - 
R21 + R12 + R22 < max (n2i, n22) + (ni2 - 
-Rii + R21 + R12 + R22 < max (ni2, (nn - 
-Rii + R21 + R12 + R22 < max (nil, (^12 - 



ni2)+ (19) 

n2i)+ (20) 

nii)+ (21) 

n22)+ (22) 

n2i)+) + max (n2i, (n22 - ni2)+) (23) 

n22)'^) + max (n22, (n2i - nii)+) (24) 



Proof: 

The bound on i?ii + i?i2 + R22, (O, is proved by a genie upperbound. Consider a genie-aided channel where 
a genie provides S''~"^^X2, W12, and Xi to receiver 2. For a block length T, we can bound R22 as follows. 



T{R22-e) < I 

= I 

= I 

= I 

= I 



(h^22; Y2(^\ S'?-"-X2(^\ VFl2,Xi(^) 

(ty22;Xi(^)) +/(Ty22;Y2(^\S'?-"-X2(^\VFl2 | Xi^^) 

(W22; S™X2(^), S™X2(^), VF12) 

(h^22;S™X2(^),S™X2(^) I Wu) 

(h^22;S™X2(^) I 1^12) +/(VF22;S™X2(^) I VFi2,S™X2(^) 

H ( S^-^-Xa^^) \W^2]-H( S^-^-Xa^^^ I W12, W22 



(25) 
(26) 
(27) 
(28) 
(29) 



+H (^S5-"^^X2(^) I Tyi2,S«-"^^X2(^)) - H (^S'?~"^^X2(^) I TVi2,S''-'"^=X2('^\ W22) (30) 
H f S«-"^^X2(^) I 1^12) + H f S'?-"^^X2(^) I 1^12, S«-"^^X2(^)) (31) 



where (|27l ) and (|28l ) hold because all messages are independent of each other. (|3T| ) follows from the fact that X2 
is a function of 1^12, W22. Using Fano's inequality, i?ii + i?i2 can be bounded as follows. 

(32) 
(33) 
(34) 
(35) 
(36) 



(37) 
(38) 



r(i?ii + i?i2 - e) < /(VFii,W^i2;Yi(^)^ 

= H (Yi(^)) - H (Yi(^) I Wii, Wi2^ 

< H (Yi^^)) - H (Yi(^) I Wu, W12, W2i^ 

= i3-(Yi(^)) -f(Yi(^) I P^ii,VFi2,W^2i,Xi(^)) 



= H (Yi(^)j - H (S™X2(^) I 1^12 

Adding (OTI ) and (l36l ). we have 

T(i?ii + i?i2 + R22-e) < H (Yi(^)) + H (s™X2(^) | H^i2, S'?-"-X2(^) 

< T (max(nii,ni2) + (n22 - ni2)+) . 

Letting T ^ cxo(e ^ 0), we prove ( fT9l ). Similarly, we can prove ( |20l ). (|2TI ). and 
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Next, the first bound on Rn + R21 + R12 + R22, (1231 ). can be proved as follows. Consider a genie-aided channel 
where a genie provides S'^~"^^Xi and W21 to receiver 1. For a block length T, using Fano's inequality, we can 
bound Rii + R12 as the following. 

T{Ru + Ri2-e) < /(Tyii,H^i2;Yi(^),S«-"-Xi(^),iy2i) (39) 
= /(Tyii,H^i2;Yi(^),S«-"-Xi(^) I 1^21) (40) 
= /(Tyii,VFi2;S'?-""Xi(^) I W2i) + /(Tyii,VFi2;Yi(^) I S5-"^^Xi(^),W2i) (41) 
= //(S^-^-Xi^^) I T^2i) - //(S-^-^-Xi^^) I P^2i, W^ii, VF12) 

+i7(Yi(^) I S''-"-Xi(^),iy2i) - ^(Yi(^) I S™Xi(^),VF2i,W^ii,VFi2) (42) 
= //(S-^-^^^Xi^^) I W21) + i/(Yi(^) I S«-"^^Xi(^), W21) 

-i7(Yi(^) I S«-"-Xi(^),VF2i,W^ii,VFi2,Xi(^)) (43) 
= F(S'?-"^^Xi(^) I W21) + F(Yi(^) I S5~"^^Xi(^),W2i) 

-i7(Yi(^) I l^i2,Xi(^)) (44) 
= F(S'?-""Xi(^) I 1^-21) + ^(Yi(^) I S''-"^^Xi('^\W2i) 

_^(Sg-ni.x2(^) I VF12) (45) 

Similarly, we have 

r(i?2i + R22 -e)< //(S'?-"-X2('^) I W12) + H{Y2^^^ I S™X2('^\Tyi2) - //(S^-'-XiC^) I W21) (46) 
Adding (|45] ) and (|46l ). we have 

T(iis - e) < i?(Yi(^) I S'?-"^^Xi('^), W21) + ^(Y2('^) | S''-"^^X2(^\ 1^12) 



< i7(Yi(^) I S-^-^-Xi^^)) + /i'(Y2(^) I S''-"-X2(^)) 

< T (max(ni2, (nn - n2i)'^) + max(n2i, (n22 - "12)+)) . 



(47) 
(48) 
(49) 

Letting T —>■ 00, we prove (1231 ). Similarly, we can prove (1241 ). ■ 
After obtaining capacity outerbounds for the deterministic X channel, we use them to derive sum-capacity 

upperbounds for the symmetric case. 

Corollary 4.3: For any achievable scheme, the sum-rate i?s can be bounded as 
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Proof: Consider any reliable coding scheme achieving sum rate Ry,. Then we can write 

4 2,2, 
-Rs < 2 max (ric, n^) + -(n^ - + -{ric - nay (50) 

Ry. < 2 max {nc,nd- ric) (51) 

Rt. <2 max (n^, nc - n^) (52) 



Inequalities (1511 ) and (1521 ) are direct results of (1231 ) and (|24l) . To prove inequality (1501 ). we do the following. 
Substituting nn = 71-22 = "-d and ni2 = n2i = Uc into ([T9l ) to (l22l) . adding the resulting inequalities together, and 
dividing both sides by 3, we obtain (l50l ). 

Further, for the symmetric deterministic X channel, if ric = rid, then both receivers receive the same signals. 
Thus, the achievable sum rate is bounded by the multiple access channel bound. 

iis < na (53) 
The result of Corollary |43] follows from (I50l)-(l53]). ■ 



B. Achievable Schemes 

The following theorem gives the sum capacity of the symmetric deterministic X channel. 
Theorem 4.4: The sum-capacity upperbound given in (14.31 ) is achievable. Equivalently, 

C^iricnd) = RT:,up{nc,nd) (54) 
Before we proceed to the proof, we will need the following lemma 
Lemma 4.5: Let n^nd be positive integers such that | < ^ < 1. Then 

1) If Uc is divisible by 3, then there exists n UdX ^ matrix V whose entries are from JT^'' such that 

rank([V S"^-"^V S^^-^n.^ ^nuu])=nd 

where \nuU is a x {rid — ric) whose column vectors form a basis for the nuUspace of S"''""'^ 

2) There exists a 3n^ x ric matrix V whose entries are from J^^"^"^ such that 

rank([V HV H^V Ynuu]) = 'ind 

where 









OridXrid 


H = 






OrtdXnd 






OrtdXrid 


gn^-n^ 



and "Vnuii represents the Zrid x {2>nd — 3nc) matrix whose column vectors form a basis for the nuUspace of H 
The proof of the lemma is placed in Appendix |ll] We now proceed to prove Theorem 14.41 

Proof: We only discuss the achievable scheme for the case that ric < rid. The achievable schemes for ric > rid can 
be obtained by using Corollary 14.11 For the case that ric < rid, the achievable scheme is split into four different 
regimes viz. < ^ < |, | < ^ < |, f < ^ < 1, and ^ = 1. 

Achievability for ^ = 1 is trivial, since an optimal achievable scheme sets 1^12 = W21 = W22 = and uses 
all the rid levels for Wu at transmitter 1. We will treat the other 3 cases below. 
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Fie. 4. Signal levels at receivers for § < — < I- 



Case i ; < ^ < f 

We need to show that max(27irf — 2nc, 2nc) is achievable. Achievability follows by setting W21 = Wu = </> so that 
the X channel operates as an interference channel. The capacity of the two-user deterministic interference channel 
found in [7], [13] implies that m.ax{2nd — 2nc,2nc) is achievable in this regime. 
Case 2 .• I < < I 

We show that a sum rate of = Iric is achievable in this regime using interference alignment over the deterministic 
set up. The achievable scheme achieves a rate of Ra = 2nc — rid for each of Wu, W22, and a rate of Rij = Ud — ric 
for W12 and W2i- 

At transmitter i, the top — ric levels are used to transmit Wu, the next — ric levels are used to transmit 
Wji, the next — levels are kept zero, and the remaining — 2nd levels are used to transmit Wu for 
= (1,2), (2,1) (See Figure |4]|. In other words, the achievable scheme transmits for i ^ G {1)2}, a 

X 1 column vector Xj which can be represented as 



X, 







'-(rid-nc) 

'ric X (rid— ric) 



X,i(l) + 







(Sritj— 3nc)x (Sric— 2nti) 



X,i(2) 



+ 







(nd-nc)x(nd-nc) 
'■(nd-ric) 







(2nc-nd)x(nd-nc) 



X 



where Im represents the mxm identity matrix, Xjj(l), Xjj(2), Xjj are column vectors of sizes {rid — ric) x 1; (3nc — 
2nd) X 1, {rid — ric) x 1 respectively. Xij(l), Xii(2) are used to encode message Wu and Xjj is used to encode Wij. 
As illustrated in Fig. |4l receiver i can recover its intended messages Wu, Wij without interference. Thus, we have 
= 2nc. Note that at receiver i, interference Xjj, Jtjj aUgn at levels — nc + 1, — nc + 2, • • • , 2{nd — Uc). 
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Fig. 5. Achievable scheme for the symmetric deterministic X channel with {nc,nd) = (12, 15) 



Case 3 : <l 

^ 'I'd 

We first consider the case where ric is a multiple of 3. For this regime, we show that i?s = 2nrf — 2nc/3 is 
achievable. 

1 ) Transmit Scheme: We use linear precoding at the transmitters. Let 'Vnuii be a x (n^ — Uc) times matrix 
whose column vectors form a basis for the null space of S"''""'^ meaning that 

»3 ^ null '-'ndX(nd— ric) 

At transmitter i, we use, as precoding vectors for Wa, column vectors of the matrix [V Ynuii] where V has 
dimension x We will shortly explain how V is chosen, but here we mention that the columns of V are 
linearly independent of 'Vnuii- Note that this implies that S"'*~"'^V has a full rank of ric/S. For Wji, we use 
gnd-ncY as the precoding matrix so that, the transmitted codeword Xj can be represented as 



X, = VX,,(1) + Vnuii%ii2) + S^^'-^^VX.i (55) 

for G {(1, 2), (2, 1)}, where Xjj(l) and Xjj(2) are column vectors of lengths n-c/S and — representing 
the bits encoding Wa. "Kji is a nc/3 dimensional column vector of bits encoding Wji. 
2) Receive Scheme: The received signal at receiver 1 can be expressed as the following. 

Yi = Xi + S"^-"=X2 (56) 

= VXii(l) + V„,;;Xn(2) + S"--"=V (X2i + X22(l)) + S2"--2"^VXi2 (57) 
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Now, receiver 1 wishes to decode Xii(l), Xii(2), X12 using linear decoding. Notice that the interference from 
X2i,X22(l) aligns along S"''~"'=V. Now, suppose we choose V such that the columns of the matrix 

G = [V S"^-"=V s2"^-2"-V \null] 

are linearly independent, then clearly receiver 1 can decode Wu, W12 using linear decoding. Therefore, in order to 
show achievability, we need to show that there exists V so that the matrix G has a full rank of n^. This is shown 
in Lemma 14.51 A similar analysis shows that, if G has full rank, then receiver 2 can decode its desired messages 
as well, using Unear decoding. 

Now, we consider the case where nc/3 is not an integer. In this case, we use a 3 symbol extension of the channel 
represented below (Channel extensions have earlier been used in achievable schemes in [5], [10], [14], [15]) 



Yi(3t) 




X,(3t) 




gn.-n, 




Xj(3t) 


Yi(3i + 1) 




Xi(3t + 1) 


+ 


s""""^ 




Xj(3f + 1) 


Yi(3i + 2) _ 




Xi(3t + 2) 




S"" 




Xj(3f + 2) 










H 







Notice that, over this extended channel, inputs and outputs are symbols over J^2^'^ ■ Like the case where ric was 
a multiple of 3, a linear precoding and decoding technique is applicable over this extended channel. The only 
difference in this case is that, we need to show that there exists a 3n^ x ric matrix V such that the matrix 

G = [V HV H^V Wnuu] 

has a full rank of 3nd, where 'VnuU represents the (3nrf — 3nc) basis elements of the null space of H. This is 
shown in Lemma 14.51 as well. This completes the proof of achievability. An example of the scheme for the case 
that (ncfirf) = (12, 15) is given in Figure |5] 



V. Generalized Degrees of Freedom of the Symmetric Gaussian X Channel 
The main aim of this section is to prove Theorem 13.21 

We first derive a useful property of d{a) - the GDOF of the symmetric two-user X channel 
Lemma 5.1: 

dia) = adi-) (59) 
a 

where d{a) represents the number of GDOF of the symmetric X channel. 

Proof: Please see Appendix J] for the proof. ■ 
The lemma is useful since we can first study d{a) for a < 1 and then use Lemma 15.11 to extend the results for 
a > 1. 

The rest of this section is organized as follows. In the next subsection, i.e. in Section IV-Al we obtain capacity 
outerbounds for the Gaussian X channel. These bounds are analogous to those obtained for the deterministic X 
channel in the previous section. In Section [V-Bl we translate the capacity outerbounds obtained in the next section 



15 



to obtain a GDOF outerbound of Theorem 13.21 In Section IV-CI we use the insights obtained for the deterministic 
X channel to show achievability of d{a) as described in Theorem 13.21 

We remind the that while the achievable schemes we describe are valid for the symmetric case only, the capacity 
outerbounds shown in Section IV-AI are valid for the general setting. 

A. Outerbounds for the Gaussian X channel 

In this section, we study outerbounds for the X channel. We first present known outer-bounds of the X channel 
using previous works in the lemma below. 

Lemma 5.2: The rate tuple i?i2, ^21, ^22) achieved by any reliable coding scheme over the X channel 
satisfies the following bounds 

Ri, < i log (1 + ) (60) 

R1J+R23 < ^log(l + max(Fi/,i/2/)Pi),i = 1,2 (61) 

R^l + R^2 < ^log{l + Ha^P, + H,2''P2),i = l,2 (62) 

Rn + R22 + Ri2 < l log (1 + Hn^Pi + Hi2^P2) + ^ log (l + ^ ) (63) 

^ ^ 1 + -ni2 P2 

R22 + R1I + R2I < Jlog(l + i722^P2+^21^Pl) +^log(l + — ^^-^) (64) 

^ ^ 1 + rl2i Pi 

Rn + Ri2 + R2i < I log (1 + Hn^Pi + gi2^P2) + ^ log (l + ) (65) 

2 ^ 1 + -Oil Pi 

R22 + R2I + R12 < Jlog(l + i722'P2+i^2l'Pl) +^log(l + — ^^-^) (66) 
^ ^ i + -"22 P2 

The bound in (1601 ) is trivial. (1611 ) and (1621 ) respectively follow from the bounds on the rates in the multiple access 



and broadcast channels contained in the X channel. (I63l)- (l66l ) follow from the outerbound shown in [16] in the 
more general context of the X channel with relays, feedback, noisy co-operation and full-duplex operation. For 
completeness we prove (l63])-(l66l) in Appendix Hn] 

In the following theorem we show Etkin-Tse-Wang bound for the Gaussian interference channel can be extended 
to the Gaussian X channel. 

Theorem 5.3: The sum rate achieved by any reliable coding scheme over the X channel satisfies the following 
bounds 

2 D_ \ 1 / ZJ_ 2 ; 



Proof: 
Let 



1 / 9 „ H^ 2 P2 \ 1 , / 9 „ H7^ P2 



Sijit) = H,jXj{t) + Zi{t),i,j e {1,2} 



Note that Sij are auxiliary variables similar to the ETW outerbound of the interference channel. Consider any 
reliable coding scheme. Now, let a genie provide S'i2(^) = i?i2^2^^^ + ^/^^ and W12 to receiver 2. From Fano's 
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Wii,W2i — >~Xi 



Wl2,W22 ^X2 




Fig. 6. Genie aided X channel used in proof of Theorem 15.3 



inequality, for any codeword of length T, we can write 

nR22 + R2i-e) < l(w22,W2i;Y2'^^\Si2'^'^\Wi2) (69) 



< / (W22, W21; Wi2)+I {W22, W2i;Y2'^^\ Su^^'^ I Wuj (70) 

< h (Y2^'^\ Si2^'^^ I W12) - h (Y2^'^\Si2^'^^\ W21,Wi2, W22) (71) 

< h (Si2^'^^ I W12) + h (Y2^'^^ I 512^^^ ^^12) - h (Y2^'^^ I Wi2, W22, W21 



-h (5i2(^) I 12^"^^ W^i2, VF22, W^2i) (72) 

< h (512^^) I W12) + h (Y2^'^^ I 512^^)) - h (Y2^^'^ I X2^'^\Wi2,W22,W21,) 
-h(^Si2^^'> I Y2^''\Xi^'^\X2^^\Wi2,W22,W2l) (73) 

< h (512^^) I W12) + h (Y2^'^^ I 512^^)) - h (F2iXi(^) + ^2^^) I VF12, W22, W21, ^2^^^) 

I y2^^\Xl^^\xf\W^12,VF22,W^21,VF2l,) (75) 

< h (Si2^^^ I 1^12) + h (y2^^^ I 512^^0 - h (S2i^^^ I ^21) - h (Zi^^A (76) 



In (ITOI ). the first summand is zero because of VF12 is independent of W2i,W22- We have used the chain rule in 
(ItTI ). In (ItSI ). we have used the fact that conditioning does not reduce the entropy on the second, third and fourth 
summands on the right hand side. In (1761 ). we have used the fact that = H2iXi^'^^ + ^2^^^ is independent of 
messages Wi2,W22 and the codeword X2^'^^. 

(T) 

Similarly, if a genie provides receiver 1 with S'^l' and 1^21, we can bound rates at receiver 1 as 

TR12 + TRu -Te<h {S2i^"^\W2i) + h {Yi^^\S2i^'^A - h (512(^^12) - h (Zi^^A {11) 
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Adding (177] ) and (1761 ). we get 

r(i?s -e) < h (yi(^) 1521 (^)) + (i2(^)|5i2(^)) - h - (z2(^) 

T 

T{Rj:-e) < Y.[h{Yi{t)\S2i{t)) + hiY2{t)\Sum - Th{Zi) - Th{Z2) 
t=i 

The second inequality above uses the chain rule combined with fact that conditioning does not increase entropy. 
Therefore, dividing by T, taking T — > cxd, and using the fact that Gaussian variables maximize conditional entropy, 
we get 

Note that the above bound on the sum capacity is identical to the ETW bound for the sum capacity of the weak 
interference channel [1]. Furthermore, we can get another bound on the sum capacity of the X channel, symmetric 

(T) (T) 

to the above bound by allowing a genie to provide 5*22 , Wu to receiver 1 and 5);',W^22 to receiver 2. In this 
case, we get 

1, , rr 2ti , Hl2^P2 \ 1, ( ^ . TT 2r, . -f^21^-Pl 



< ^ log ^1 + /fn'Pl + ^^^j + ^ log ^^1 + H^.'P^ + ^ ^ 

■ 

B. Generalized Degrees of Freedom Outerbound 

We now translate the capacity outerbounds stated above to a generalized degrees of freedom outerbound. We 
only find an GDOF outerbound for a < 1 below, since for q > 1, we can use lemma |5?T] along with the following 
theorem to bound the GDOF. 

Theorem 5.4: The GDOF of the X channel for a < 1 can be bounded as 

d{a) < 2 mill (max(a, 1 — a), 1 — a/3) 

Proof: Now, for the X channel where Hu = H22 = \fp, H21 = H12 = ^'^'^ A = -P2 = 1 the 

outerbound in (|67] ) leads to 

i?s(p,a)<log(l + p° + -^) 

1 + yO" 

Dividing the above inequality by ^ log p and then taking limits as p ^ cxd, we get 

d{a) < 2max(a, 1 — a) (78) 

Similarly, the bounds in ([63l)-(l66]) lead to 



iJll + iil2 + i?22 < -log(l + /> + p") +-log(l + ^^^^) 



R22 + RU + R21 < ^log(l + /> + p°) + ^log(l + -^) 

2 2 1 + /9" ' 
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+ i?12 + i221 < -log(l + p + p") +-log(l + ^ 



R22 + R21 + R12 < Jlog(l + p + p") + Jlog(l + -4^] 

2 ' 2 1 + p' 
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Adding, we get 

3(i?ii + Ri2 + R21 + R22) < 2 log(l + p + p") + log(l + — ^) + log(l + -4^) 
^ 3Cs(p, a) < 41og(l + /9 + p") - log(l + p)- log(l + 



Dividing the above inequality by i log p and then taking limits as p ^ 00, we get 



d(a)<2-^ (79) 



Therefore, from dTSjl, (1791), we get 



d(a) < 2 mill ( max(a, 1 — a), 1 



C. Achievability of Generalized Degrees of Freedom 

In this section, we provide an outline of the proof for the achievability of Theorem 13.21 The main idea of 
the proof is to transform the symmetric Gaussian X channel to the deterministic X channel by imposing some 
structure on the transmit signal. Then, we apply the achievable scheme derived in the previous subsection to obtain 
the GDOF result of the Gaussian case. The proof follows the similar arguments used in [12], [17], and we include 
an outline of the proof for the sake of the completeness. We only consider the case that < q < 1 here. The GDOF 
characteriation for a > 1 follows from Lemma 15.11 The symmetric Gaussian X channel is defined by ([TTI).(IT2l). 

For a given a G [0, 1], we can find a pair of non-negative integers {nd,nc) and a very small nonnegative value 
e such that 

a = — {nc + e{nd - ric)) . (80) 
nd 

Note that when a is a rational number, e is chosen to be zero. But when a is not rational, e{nd — nc)/nd is used 
to compensate the difference between a and a rational number ^ that is very close to a. Also note that (tic, n^) 
is chosen such that (|T5] ) can be achieved without symbol extension for the symmetric deterministic channel with 
parameter (nc,nrf). 

Consider the sequence of channels, i.e. p indexed by N such that 

P = Q— (81) 

where Q is a very large but fixed positive integer and is a positive integer whose value grows to infinity. Note 
that p grows to infinity as N grows to infinity. 

For this channel, we describe the GDOF optimal achievable scheme, for a given a below. 

1 ) Transmit Scheme: We impose the following structure on the Q-ary representation of the transmit signal Xi at 
transmitter i for i G {1,2}. 
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In other words, the Q-ary representation of the transmit signal Xi looks like ■ ■ ■ Xi^2Xi^iXifl.Q^ ■ ■ ■)q 

The values of Xj ^ are restricted to the set {1, ... , L^^ — Ij} to ensure that addition of interference does not produce 
carry over. Since e is a small non-negative value, we have 

\ 21 



E[X 



E 



P 



< -E 

P 



^ /Nna-l \ 

- ( E 

k=0 J 



k=0 



< 



Q 



< 1 



Thus, the encoding scheme satisfies the power constraint. 



(83) 

(84) 

(85) 
(86) 

, u-i , we can use it to find 

the transmit signals Xi,X2 G J^^q-i „ for the symmetric deterministic channel with parameter {ncrid) and then 
obtain the corresponding Xi,X2 G M+ by 

1 

Vp 

where the last term Xj is the Nud x 1 transmit vector for the deterministic channel. 

2) Receive Scheme : Each receiver takes the magnitude of the received signal, reduces to modulo Q^""', discards 
the value below the decimal point, and expresses the result in Q-ary representation as 



Since the achievable scheme developed in the previous subsection also works in 



Q-i 



Q 



Q 



Nna-2 



Q2 Ql 1 



(87) 



Yi 



I Yi I mod Q 



(88) 
(89) 

(90) 



yi'kQ'', yfc,»G{0,l,...,Q-l} 

Substituting dSOl ) and dSTT ) into (fTTl) and (fT2l) . we can rewrite the input output equation as 

Y, = X, + Q^("^)X, + Zi, e {(1, 2), (2, 1)} 

where 

Xi = ^pXi 

Note that multiplication by Q^i'^^-^d) shifts the decimal point in the Q-ary representation of Xj by N{nd — ric) 
places to the left. Therefore, in the absence of noise, the Nrid digits of Xi, X2,Yi, and Y2 behave exactly like 
the symmetric deterministic channel with parameter {Nuc, Nn^). Next, we will consider the effect of AWGN. Let 
be the probability that 



Yk + ^ 



k+N{ni-n^) 



(91) 



happens for any (i, j) G {(1, 2), (2, 1)}. Due to fact that any additive noise with magnitude no greater than ^ 
does not affect the coefficient of Q^, we have 



l-Pk> Prob [\Zi\< Q''-\ IZ2I < Q 



-^k-l 



(92) 
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Thus, monotonically decreases to as A; grows to infinity. A key result of this observation is that the multi-level 
coding approach [17] approximates the deterministic channel within o{N). Thus, we have 

Q-1 



Rt. = RT.4et{Nnc,Nnd) log 
= NRj:^det{nc,nd)logQ 
Combining ([lUl, (tlH), and ([TOl), we have 



4 

Q-1 



+ o{N) 
+ o{N) 



d{a) > limsup 



+ o{N) 



1-e 



^-Rj:,det (ridi % — ^ \ ,nd \ log 



Q-1 



(93) 
(94) 



(95) 
(96) 



Carrying out the substitution of Rj:,det{-, choosing Q and e to be arbitrarily large and small respectively, and 
comparing with the outerbound, we finish the proof of Theorem |3.2[ 



VI. Capacity of the Noisy X Channel 

We state the result for the general (asymmetric) case as follows. 
Theorem 6.1: If 



H 



H, 



^2 ^1 + HlP^] 



22 



+ 



H 



^1 + Hf^P2) 

11 



< 1, 



then the sum capacity of the Gaussian X channel is given by 



2 l + Hl^P2 



I + Hi Pi 



Similarly, if 



H 



'l + Hl^Pi] 



12 



+ 



H 



" 'I + HIP2) 
21 



< 1, 



then the sum capacity of the Gaussian X channel is given by 

+ ^ log ( 1 + 



1, Hi.Pi \ 1 



CE = -log( 1 + 



Proof: Let 



1 + -^^22-^2 



HI2P2 

1 + Hl^Pi 



(97) 



(98) 



(99) 



(100) 



Si{t)=Xi{t) + Zi{t), i = l,2 
Zi is white Gaussian with zero mean and variance af. Also, let Zi{t) be correlated with Zi{t) as 



E 



Z,{t)Zi{t) 
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Let a genie provide to receiver 1 and ^2 to receiver 2. Now, we can write using Fano's inequality for a codeword 
spanning T symbols, 



T{R22 + R2i-e) < l(W22,W2i;Yf\s^P iWu) (101) 

< h (yP , SP I W12) - h (yf ) , SP I 1^12 , W22 , W21) (102) 

< h (^SP I W12) + h (yP^ I SP^ - h (^SP I W12, W22, W2i,xP^ 

-h (yp^ I sP,Wi2, W22, W2i,xP) (103) 



< h (^SP I Wu) + h (rp'^ I SP^ - h (^XP + ZP I Wi2, W22, W2i,Xp^ 
-h [h2iXP + H22XP + zP I zP,Wi2, W22, W2i,sP,xP'^ (104) 

< h (Sp'^ I W12) + h {Vp'^ I 5f ^) - h (^H2iXP + zP I W2i,Z2{T)^ - h (^Z^^S) 

where ( 11031 ) holds because we have applied the fact that conditioning reduces entropy in the second,third and fourth 
terms. In (11051 ) we have used the fact that Xp\W22, W12 are independent of xP , zP and zP . 
Similarly, we can bound rates R12 and Rn as 

T{Ru + Rii-e) < h (^SP I W21) + h (rp^ I SP) - h (Hi2xP + zP \ W12, Zi{T)) - h (^zP^6) 
Adding (11051 ) and (11061 ) we get 

TiRii + R12 + R21 + R22-e) < h (^xP + zP I Wi2^ - HHuXP + zP \ Wu, zP) 

^ V ' 

+ h (xP + zP I W21) - h{H2iXP + zP I W21, zP) 



U2 



+ hiYP\sP) + hiYP\sP)-hizP)-hizP: 



Us 

The rest of the proof goes along the same lines as described in [4]. We only highlight the differences here. 

We first notice that U3 is maximized if we choose Xi to have a Gaussian distribution, since conditional entropy 
h{Y^ \Sl ) is maximized by the Gaussian distribution. Therefore, we can write 

f/3 < KyP^PsP) + KYgpsP) - h{zP) - h{zP) 

where for i = 1,2, X^q , Y^q , S^q are variables obtained by using a Gaussian i.i.d sequence of power Pi for X^. 
Now, following the proof of [4], we derive conditions on 774, cjj for i = 1, 2 so that circularly symmetric Gaussian 

(T) 

distribution on X^ maximizes Ui and U2 as well. Specifically, we choose 

al < (107) 

-"21 



22 



and circularly symmetric independent Gaussian variables V^'^\ y/^^ such that V ~ M{0, 1 — ~ ^1) Vi 
7\A(0, cr^). Now, we observe that 



h[xP + Z- 



21 



(T) 



(a) 
< 

< 

(fe) 
< 



./,(y(T))+/,(y(T)|^{T)^^(T)+^m) 



; ^2 



In the first term of the summand in (a), we have used the fact that y(^) is independent of W12 and in the second 
summand of (a), we have used the fact that conditioning reduces entropy. Inequality (6) holds because of the worst 
case noise lemma [18] as long as ( 11071 ) is satisfied. Along the same lines, by choosing 

1 



-"12 



(108) 



we can bound Ui in a similar manner. Therefore, we can write 

T{Rii + Ri2 + R2i+R22-e) < h(x[y + zP 



h ( H2iX^ + 



Z. 



(T) 



+h{xg^ + zP)-h[H,2Xg^ + zP \Z 



(T) 



(^IG ^ I "^IG^ ) + ^ (^2G ^ I '^2G^ ) 



+h{Yl^'\S 



h Z 



1 

-I- 1 1 yi.2G ' -'2G ' '^2G 



h Z. 



The rest of the proof follows Lemma 10 in [4]. Specifically, it can be shown that if 



Hiiair]i 

-f^22'72??2 



Hl^P2 + 1 
Hl^Pi + 1 



(109) 
(110) 



then. 



implying that 



^ y^lG ' IG ' ^IG 
I ^2G ' -'2G ' '^2G 



Ru + R12 + i?21 + ^22 < ^log[l + 



^ I ^IG ' MG 
J I ^2G ' -'2G 



1 + ^22^2 



+ 2 log 1 1 + 



H22P2 
1 + 



Also as shown in [4], (11071 ). (I108I ). (11091 ). (11101) can be combined as 



H 



12 



22 



l + H'2,Pl] 



+ 



21 



11 



,1 + ^12^2) 



< 1, 



(111) 
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Equations dlOOl ). (|99l ) can be derived similarly. This completes the proof. ■ 

VII. Conclusions 

We found the generalized degrees of freedom(GDOF) of the symmetric two-user Gaussian X channel. To find 
the GDOF of the X channel, we first found the sum capacity of a deterministic X channel and extended insights 
gained from the deterministic case to obtain the GDOF of the Gaussian channel. In the process, we found an 
outerbound for the sum capacity of the two-user Gaussian X channel that coincides with the bound on the sum 
capacity of the two-user interference channel derived by Etkin, Tse and Wang in reference [1]. The implication 
of the bound is that, for certain regimes, the performance of the X channel is identical to the performance of 
the two-user interference channel from a GDOF perspective. However, for other regimes, we showed that the 
X channel outperforms the interference channel through an interference alignment based achievable scheme. Our 
result therefore characterizes the benefits obtained from interference alignment from a GDOF perspective. While 
our results characterize the GDOF of the X channel in the symmetric setting, an interesting and important area of 
future work lies in extending the study of the general setting which is not symmetric. In particular, there lies open 
the question of whether new outerbounds are required to characterize the GDOF in the asymmetric case, or whether 
the current bounds are tight. In the Gaussian multiple access, broadcast and two-user interference networks, the 
capacity of the appropriate deterministic channel is within a constant number of bits of the corresponding Gaussian 
channel. It is an imporant open question whether the solution to the deterministic X channel provided in this work 
leads to useful approximations of the capacity of the Gaussian X channel. 

As a by-product of the main result, we also extended bounds derived for the interference channel in [2]-[4] to 
the two-user X channel. The bound implies that, for certain class of channel coefficients, it is capacity optimal in 
the two-user X channel to set two messages to null so that it forms an interference channel, encode both non-null 
messages using Gaussian codebooks and decode at both receivers by treating interference as noise. Therefore, 
interestingly, for a class of channel coefficients, certain messages do not contribute to the sum capacity in the X 
channel. An interesting open question related to this result is whether there exist channel coefficients in the two-user 
and/or larger X networks, where setting other sets of messages to null is sum-rate optimal. 
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Appendix I 
Proof of Lemma IsTTI 

The symmetric interference channel maybe represented as 

Yi{t) = pXi(r)+p"X2(r) + Zi(r) 
Y2{t) = p"Xi(r)+pX2(r) + Z2(r) 

Now, by simply switching the two receivers in the X channel, the input-output relations maybe alternately 
described as 

Y[(r) = pX,[r) + {prX2{T)+Z[{T) 
Y^ir) = ipr'x,iT)+pX2iT)+Z'^{T) 

where 



y; 


= Y2 , 


■ ^2 = 


Yi 




= Z2 . 


1 ^2 — 


Zi 








1 


p 


= : 


, a = 


a 



Note that the capacity of the X channel described in equations (II 121 ). (II 12b is Cj]{p , a). Further more, since simply 
switching the receivers of the original X channel does not alter the sum capacity, we can write 

Cs(/o',a') = C^ip,a) 
- lim = lim 



C^{p',a') 
lim a— j — — = a{aj 



I log(/5' 

^ ad{a ) = d{a) 

=^ ad{—) = d{a) 
a 

Appendix II 
Proof of Lemma 143] 

We start with a proof of part 1 of the lemma. Before going into the detail, we want to point that Lemma 
is for (nc,n^) such that | < ^ < 1. For part 1, it should also be noted that ^ is a positive integer. To simply 
notation usage, let 

H = S"''-"^ (112) 
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spanje, ,He| ,...) spanje, ,He7,...| spanje, ,He, ,...} 

Fig. 7. A pictorial representation of tiie cyclic decomposition of JT^'' with {nc,nd) ~ (10, 13). 



J^2'^ can be expressed as the following 

^='2" = span(ei,e2,e3, . . . ,e„^_i,e„J (113) 
= span (e Hei, He2, . . . , He„,_„^, . . . , H'^efe) (114) 

= span ^ei, Hei, H^ei, . . . , Hl-"d-"<=-l ei^ © span ^e2, He2, H^e2, . . . , Hl-"<i-"<^-l e2^ 

© • • • © span ^e^^.n^, He„^_„^, H^e^^.^^, . . . "<i— \ en^_n, j (115) 

where is the ith column vector of an identity matrix in JF^'*^"'*, and © is the direct sum operator for 
subspaces. Note that in step (a), we recursively use the property that when < i < nc, we have 



S^^'^^^ei. (116) 



The (n, k) G in (II 141 ) satisfies n{n(i — nc) + k = and 1 < A; < nj^ — ric, and can be uniquely determined. In step 
(b), we reorganize the basis and divide the basis into several subsets. An example of the case that {ric, rid) = (10, 13) 
is illustrated in Fig. |7] 

Conceptually, dllSI ) decomposes ^^"^ into several disjoint subspaces. This decomposition is called cyclic decom- 
position in the content of linear algebra [19]. There are some interesting properties for this decomposition. First, 
multiplying H to any vector lying in the subspace spanned by {ej, Hej, H^ej, . . .} results in another vector lying 
in the same subspace. Thus, spanjej, Hej, H^ej, . . .} is called an H-invariant subspace of J^''. Second, the total 
number of the H-invariant subspaces for J^'' is equal to the number of the dimensions of ker(H) (Theorem 8.2.19 
in [19]). Third, J^"^ can be expressed as the direct sum of all H-invariant subspaces. Due to the specific structure 
of S"''~"% the difference between the number of dimensions of any two H-invariant subspaces is less than or equal 
to one. 

After obtaining a new basis for J^"^, we can express any vector in JF^** as a linear combination of the vectors 
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O • H'^'e 



i+l 



Fig. 8. The pictorial representation of the linear combination of two vectors: H'^ei and H'°"''^ei+i. 



Hv = He, 



Fig. 9. Box 1 and the vectors associated with it. 



in the basis. We use Fig. [8] to illustrate our usage of notations. We then introduce five different boxes illustrated 
in Fig. |9] to [13] Each box contains three circles and represents a set of three vectors {v, Hv, H^v} for some v in 
J^''. Note that these vectors are linearly independent. 

We then use the following algorithm, including five steps, to decompose a plot representing a cyclic decomposition 
of J^"^ into a set of circles representing the basis of ker(H) and a collection of the boxes shown in Fig. |9]to [T3l 

STEP 1: Collect the circles located in the bottom of each column. This gives us the set of circles representing 
the basis for ker(H). 

STEP 2: Starting from the top of each column, put as many boxes shown in Fig. |9] as possible in each column. 
Note that the condition ^ > | ensures that at least one such box can be put in each column. After this step, each 
column has at most two unassigned circles. 

STEP 3: For the remaining unassigned circles, starting from the left-most place and then gradually moving to 
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V = He,. + e,.^| Hv = H'e, + He,.^, H'v = H'e, + H'e,.^ 



Fig. 10. Box 2 and the vectors associated with it. 
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v = He,+e,^i Hv = H'e;+He,^i H'v = tfe+H'e 



Fig. 11. Box 3 and the vectors associated with it. 
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Fig. 12. Box 4 and the vectors associated with it. 



the right, alternatively put as many boxes shown in Fig. [TO] and boxes shown in Fig. [TT] as possible. 

STEP 4: For the remaining unassigned circles, starting from the right-most place and then gradually moving to 
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V = e,. + H<?,.^| Hv = He,. + H'e,.^, H'v = H'e,. + H'e,.^ 



Fig. 13. Box 5 and the vectors associated with it. 
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(«,,«,) = (12,15) 



(«,,«„) = (27,33) 



(«,,«,) = (36,44) 



Fig. 14. Illustration of the algorithm. 



the left, put as many boxes shown in Fig. [12] as possible. 

STEP 5: After steps 1 to 4, if there are stiU some unassigned circles, they would have the exactly same shape as 
the box shown in Fig. [13] Thus, we could use the box to group the remaining circles. This is the end of all steps. 

The algorithm is illustrated in Fig. [14] Note that at the end of steps 2 to 4, if there are no unassigned circle, 
the algorithm is terminated immediately. After step 1, there are iic unassigned circles. Because each box contains 
three circles, we need a total number of ^ boxes to assign all the circles. Now we are ready to find the column 
vectors of V. 



Let Vj be the first vector represented by a specific box for i = 1, 2, . . . , Let V G jFg ^ be constructed as 



V 



Vi V2 



(117) 
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OHei OHe^ OHgj OHe,^ OYie,, 0\{e^^ OHe^v ^He^g OHe^, 



OH'e^ OH'gj OH'e3 ^H'^i^ OH'ejj OH'^i, OH'e^^ OH'e^g OH'e 
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OH^e, OH'e, OH^e, OH^ei4 OH^Cu °H^ejg OH^e^? OH^e^s OH^e29 
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Fig. 15. A pictorial representation of the cyclic decomposition of representing the signal space of the 3-symbol extension of the case 
that {nc,nd) = (10, 13). 
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Fig. 16. A pictorial representation of the cyclic decomposition of J^''- representing the signal space of the 3-symbol extension of the case 
that (nc,nd) = (10, 13) after reordering and grouping. 



Now consider the following matrix 

V HV H^V 
Vi V2 • • • V: 



Hvi Hv2 Hvn^ H^vi H^va H^vi 



(118) 



Using the fact thatjvj, Hvj, H^v,} are Uneariy independent for i G {1,2,...,^} and the fact that vectors 
represented by a specific box can not be written as a linear combination of vectors represented by the other 
boxes, we have the result that all column vectors of [ V HV H^V ] are hnearly independent. Therefore, we 
have 



rank ^ 



V HV H^V 



rir 



(119) 



and 



J^" = ker(H) e col(V) ® col(HV) © co^H^V). (120) 
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This concludes the proof of part 1 of the lemma. We now proceed to part 2. 

The proof follows the similar steps with those for part 1, but we need some extra arrangements to deal with 
channel extension. 

J^2""' can be expressed as the following 

•^2"" = span(ei,e2,e3, . . . ,e„^_i,e„J © span (e„^+i, e„^+2, e„^+3, • • • , e2nd~i, e2nj 



(a) 



©span (e2„^+i, e2„^+2, e2„^+3, • • • , e3„^_i, e3„J (121) 
span (ei,. . . , e„^_„^, Hei, . . . ,He„^_„^, . . . ,H"efe) 

©span {ena+l , • • • , e2nd-n, , He„^+i , . . . , He2nd-n, , • • • , H^e^^+fc) 

©span (e2„^+i, . . . , e3„_,_„^, He2nd+i, • • • , He3„^_„^, . . . , H"'e2na+k) (122) 

where the notation usage is similar with those used in previous section. The (n, k) € in (11221 ) satisfies n^rid — 
Tic) + k = rid and I < k < — Uc, and can be uniquely decided. Note that there are three disjoint subspaces in 
(11221 ). and we can apply the similar decomposition used in (11 151 ) to decompose each subspace. An example of the 
3-symbol extension of the case that {nc,nd) = (10, 13) is illustrated in Fig. [15] 

One can easily observe that a part of the plot is duplicated twice to form the whole plot, and the part that is 
duplicated has the same structure with those in Appendix HIl Since each column represents a basis for an H-invariant 
subspace, we can simply reorder the columns to let the new plot have the same structure with those in Appendix 
Hn The idea is illustrated in Fig. [16] Also note that the number of circles not at the bottom of each column is Sric 
which is a multiple of three. Thus we can use the algorithm introduced in Appendix [11] to decompose the plot and 
obtain a V G jc|ndxn. ^^^^ ^^^^ 



V HV H^V 



3nc (123) 



rank 
and 

J^l""^ = ker(H) © col(V) © col(HV) © co^H^V). (124) 

This concludes our proof. 

Appendix III 
Proof of Lemma [5T2] 

We intend to prove ([63])- (l66] ) here. We only show (1631 ). All the other bounds follow by symmetry. Since we 
intend to bound Ru + R22 + R12, we set W21 = 4> and show 

R11 + R22 + R12 < log (1 + Hl^Pi + ^^2^2) + log (1 + , , ''2'^ ) 

i + H^2^2 

Note that setting W21 = 4> does not affect the converse argument since it does not reduce the rates of the other 

(T) 

messages. Now, we let a genie provide , VFn, W12 to receiver 2. Now, using Fano's inequality, we can bound 
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the sum-rate + R12 + R22 as follows 



TR22 + TRu+TRi2-Te < I{Y,'' > ■,Wn,Wi2) + I{yP ,Yl' ' ,Wu,Wu;W22) (125) 

< / (yP ■,Wn,Wi2)+I (yP , yP ,;W22\ Wu ,^^12)+/ {Wu , W12 ; TO)6) 

< / (yP- 1^11, 1^12) + / (yP,yP, ■ H^22|^ii, 1^12) (127) 

< h {yP) - h (yP\Wii, W12) + h (yP,yP\Wii,Wi2) 

-h {yP ,yP\W22,WiuWi2) (128) 

< h (yP) + h {yP\yPWiu W12) - h {yP,yP\W22, ^^11,^^12) (129) 



< h{YP)+h[YP\YP,W,„W,2.xP 



< 



- h ( yP , yP \W22,Wu,Wi2, X^P , XP ) (130) 

(T) 



h(YP)+h(^sg^\s['^\Wn,Wi2,xi 



-h {zf\zP\W22. W^ii, W^i2, Xf \ Xf (131) 

< K(YP)^K{sfMS)-^[z?\z'P) (132) 

r T 

< Y.^{Y^(T))+Y.^{S22{r)\S^2(r))-h(zf\zP) (133) 

T=l T=l 

r2 D ( Tj2 D \ I T^i„„ 111 22 2 



< r log (1 + Hi^P^ + Hi^P2) + r log (^1 + ^ ^ J (134) 

where, in (1126b . the second term is zero since all messages in the system are independent of each other. The second 
term in (11291 ) is obtained by combining the second and third summands of (11281 ) using the chain rule. In the first 
summand on the right hand side in ( 11301 ). we have used the fact that given W\\, X\ is known at receiver 2, since 
W^2i = 4>- In the second term in (11301) . we have used the fact that conditioning on xP and xP does not reduce 
entropy. In (11311) . we have cancelled the effect of xP from yP ^yP . In (11321 ). we have used the fact that 
conditioning does not reduce entropy, and in the final term, we use the independence of the noise terms w.r.t the 
inputs and messages in the systems. In the final two steps, we have used the convexity of mutual information, 
and the fact that that circularly symmetric Gaussian variables maximize differential and conditional entropy under 
a covariance constraint. The bounds in (I64l)-(l66l) can be shown by applying similar arguments as above to the 
appropriate Z channel. This completes the proof. 
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